
Robot Turns 
Planetary Geologist 
as Scientists and 
Engineers Team Up 

By Nancy Ann Budden 



human is cloaked in a pair oi wired gloves and a helmet 
seated in a rotating chair. As he slowly moves his hands am 
body, a large white robot behind him performs a slow grace 
ful mimic of his every motion. The robot grasps rock tong* 
picks up a rock from the floor and drops it into a sampl 
container, closes the container, and places it on a table. Th 
human operator performs as if in mime, without tongs, with 
out rocks, gloved hands empty. This demonstration take 


place in a NASA laboratory. Would this experiment work equally wel 


if the robot was hundreds of thousands of miles away, on the surface o 


the Moon or Mars? 

The experiment described above is a demonstration of ful 
immersion telepresence, using a robot under human control to perforn 
routine geological tasks. But we are also witnessing the marriage of twt 
cultures, two areas of expertise — planetary science and exploratioi 
working together with intelligent systems and robotics. Planetar; 
scientists and robotics engineers at NASA’s Johnson Space Center haw 
teamed up to study the feasibility of using virtual reality and telepresen 
robots to explore the planetary surfaces of the Moon and Mars. Thei 
efforts are focused on the specific capabilities and applications o' 
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DART creator Larry Li operates DART while draped in full immersion telepresence gear, 
consisting of virtual reality helmet, cyber gloves, arm wires, and audio command system 


a robot called “DART," the Dexterous 
Anthropomorphic Robotic Testbed, developed by 
a team led by NASA robotics expert Larry Li. 

Mag Missions to 
me Mon and Mars 

Mission analysts in the Planetary Missions and 
Materials Branch develop options for lunar and 
Mars missions that tell us where we are going, 
how we will get there, how many crew we need, 
what we need to take, and what we will accom- 
plish on the surface. Such planning has in the past 
included the use of robots to conduct routine sci- 
entific tasks and explore planetary surfaces. 

Robots of this type require human operation 
(telepresence) and are thus highly interactive. 

These “robotic field geologists" may look like the 
Star Wars C3PO with a rock hammer, but in fact 
they are under full human control. NASA engi- 
neer Joyce Carpenter and I teamed up to answer 
the question: “Can DART really perform basic 
*asks of geologic exploration?” 

Goal and Bbjective of the Study 

Our primary objective was to team up a group 
of scientists and engineers from two different 
NASA cultures, and simulate an interactive teleoperated 
robot conducting geologic field work on the Moon or Mars. 
The information derived from the experiment will benefit 
both the robotics team and the planetary exploration team 
in the areas of robot design and development, and mission 
planning and analysis. 

The Earth Sciences and Space and Life Sciences Division 
combines the past with the future contributing experience 
from Apollo crews exploring the lunar surface, knowledge of 
reduced gravity environments, the performance limits of EVA 
suits, and future goals tor human exploration beyond low 
Earth orbit. The Automation, Robotics, and Simulation 
Division brings to the table the technical expertise of robotic 
systems, the future goals oi highly interactive robotic capabili- 
ties, treading on the edge ot technology by joining for the first 
time a unique combination ot telepresence with virtual reality. 

Geologic Exploration: 

Recoonaissaoce and Field Stud) 

Exploration can be divided into two broad categories: 
reconnaissance and field study. Reconnaissance provides an 
incomplete but broad characterization ot the geologic features 
and processes on a planetary body. If could include global geo- 
chemical and geophysical surveys, where large geologic forma- 
tions and structures are identified and mapped into a global 
picture, at regional scales. Reconnaissance could be accom- 
plished using orbiting satellite mappers and/or surface rovers, 
possibly in combination with human exploratory sorties. 

The "closer look" of geologic field study attempts to 
understand geologic processes and units at all levels ol 


detail, on local rather than regional scales. It involves study- 
ing and sampling the rocks in their natural environment, in a 
highly iterative process that may require repeated visits to 
the same site interspersed with rock analyses in the laborato- 
ry and revisions of the scientists hypotheses about the geo- 
logical history of the investigation site as new information 
emerges. The course of study may be completely changed by 
the clues contributed by a single significant rock sample. 
Characterizing planetary surface features with such scrutiny 
will require some combination of highly intelligent robotic 
systems and human explorers. 

Kev elements necessary for geologic exploration are inten- 
sive work capabilities such as mobility, strength, manipula- 
tion, and the ability to perform both arduous and fine scale 
tasks. Of equal importance is the guiding influence of human 
intelligence and experience. Only humans can take brand 
new' observations, integrate them into the brain s stored mem- 
ory of geologic settings encountered in person and in study, 
and come up with a novel idea, or an integrated synthesis. 

Geologic Robots: me Idea Emerges 

Because many regions ot a planet may be hostile or inacces- 
sible for humans (too hot, too cold, too steep, too stormy), the 
idea of using robots to explore certain planetary sites is a desir- 
able mission option. Paul Spudis ot the Lunar and Planetary 
Institute and Jell Taylor oi the University of I Lnvaii were the 
first to suggest that one effective wav to accomplish the goals 
of geologic field study on the Moon is through the use of tele- 
operated robots under the direct control of a human geologist 
who remains at a lunar base, in lunar orbit, or on Earth. 
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Using teleoperated robots has many potential 
advantages when the alternative would place 
human explorers in difficult and hazardous ter- 
rain. Robots could be built with a global traverse 
range and optical and sensory abilities optimized 
for geologic field work. This would allow the 
robot to chemically analyze a rock as soon as it 
encounters it, where the human would have to 
return the rock to a laboratory to run analyses 
later. Robots can possess physical strength supe- 
rior to humans, and have the ability to work in a 
harsh lunar or Martian environment unencum- 
bered by complex and massive life-support sys- 
tems. Robots would also be less affected by 
radiation exposure and micrometeorite impacts. 

Scientific discovery most frequently makes its 
greatest advances by the unveiling of the unex- 
pected. Spudis and Taylor acknowledged that 
preprogrammed, fully autonomous machines 
were incapable of the on-site, spur-of-the- 
moment decision making necessary to change 
and revise an ever-evolving hypothesis of study. 

Human intelligence, experience, and interaction 
during planetary field work is an absolute 
necessity to explore the unexpected or never 
previously encountered. 

Working with Spudis and Taylor in 1989, space 
artist Pat Rawlings painted a rendition of what a 
prototype robot field geologist might look like. Its coinciden- 
tal resemblance to DART is uncanny. In fact, DART is very 
similar to the type of robot that future planners employ in 
their missions. For this reason, it is the perfect candidate to 
test-run exploration tasks, in an attempt to see just how diffi- 
cult it would be to do planetary geology using telepresence. 

Cat We Really Do Robotic Geology? 

Until our experiment, nobody had attempted to test just 
how capable a teleoperated dexterous robot could be. Can 
we realisticallv expect to accomplish ambitious geologic 
studies on an extraterrestrial surface using teleoperated 
robots? We decided to conduct a simulation of planetary 
exploration using an actual robot (DART), real state-of-the- 
art telepresence gear (Full Immersion Telepresence Testbed 
or FITT), real geologic tasks to accomplish, using real 
Apollo lunar geology tools, and veal Farth rocks. 

“Virtual Presence” Master and Slave System: 
ill! and DARI 

NASA project developer Larry Li describes his system as 
a “master-slave svstem. ’ It combines robot telepresence 
technology with virtual reality, thereby coining the term 
“Virtual Presence." 

The master, a human fitted with the III T gear, pro- 
vides operator control ot the slave robot via the use of 
telepresence and virtual reality equipment. Mil consists 
of a virtual reality helmet tor stereo visual feedback, 
magnetic sensors on the helmet and wrists to track head 


and arm movements, and two high-tech cyber gloves 
resembling fully wired racing gloves. 

Once the human operator is draped in FITT, the 
DART robot will copy anything the operator does from 
the waist up. DART is not yet fully mobile, so the opera- 
tor sits in a motorized chair which can rotate via foot 
pedals to spur a similar motion for DART. Anything that 
the operator can see through the helmet camera can also 
be seen and recorded by the robotics support team on an 
external video screen in the lab. The helmet is fitted with 
a microphone that transmits certain preprogrammed ver- 
bal commands to DARI. 

The slave, the Dexterous Anthropomorphic Robotic 
Testbed, is a human -like dexterous robot consisting of a 
stereo camera for a head, a rotating torso with two arms, 
and two “hands." One hand is equipped with a high reso- 
lution camera located under the thumb. DART can move 
this hand close to an object of interest tor a close-up view. 
Voice commands lrom the MI I operator instruct DART 
to freeze, resume motion, or to switch camera view from 
head to hand camera. Functionally, DARI is partitioned 
into six subsystems: arm, hand, head, vision, base and 
voice. La eh subsystem is connected by Lthernet for com- 
munication. Sophisticated software sends information 
between the systems. 

DART’s highly dexterous hands have the eerie appearance 
and texture of human hands wearing rubber gloves. Each 
hand has 12 motors driving steel cables. I he hands were 
developed hv Dr. Ken Salisbury at Stanford and the Jet 
Propulsion Laboratory. The head subsystem consists of two 
color CCD cameras that provide stereo visual perception to 
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the human operator. This subsystem also features a laser 
ranger on the camera to specify targets of interest and mea- 
sure their distance from the robot. 

Generating a task Prntncnl fnr DART 

Testing DART for geologic ability first required generat- 
ing a list of tasks that would be likely for a robotic field geol- 
ogist to perform on the Moon or Mars. These tasks fell into 
three operating categories: dexterity, tool operation, and 
optics and imaging. To evaluate dexterity, we asked DART 
to perform such actions as picking up and very slowly rotat- 
ing several sizes and types of rocks, placing each in a sample 
bag, and closing the bag. 

To assess tool operation we first gathered together a col- 
lection of geology hand tools. In an effort to simulate the 
equipment likely to be used in extraplanetary exploration, 
we selected the geologic field tools used during the Apollo 
missions. These include a rock hammer, rake, shovel, rock 
retriever (tongs), core tube, and gnomon (a color and orien- 
tation device). We also gave DART other non-Apollo items 
to manipulate, such as a flashlight, a iron analyzer called a 
Mossbauer, a sample bag, and a bucket full of rocks. 

We asked DART to hold and move the flashlight, pick up 
a rock hammer and strike and chip a rock, pick up and 
operate a rake, hoe, rock retriever, core tube, deploy the 
gnomon, and pick up and operate a Mossbauer iron analyz- 
er. Finally, to assess whether the optics and imaging were 
adequate for rock identification, we administered a rock test 
to DART Very fine and specialized eye-hand coordination is 
required in a true field setting to examine rock samples at 
close range to differentiate their color, size, and subtle tex- 
tural and crystalline features. 

To conduct a fair test required that a “real” geologist 
actually wear the FITT telepresence gear, operate DART, 
and observe the rocks on his helmet screen. The test provid- 
ed us the additional advantage of assessing how user-friendly 
the FITT exoskeleton and helmet would be to someone new 
to the system who had no prior training in telepresence. 
During the test our geologist was instructed to operate 
DART and select, pick up, rotate, and examine a dozen 
rocks and minerals. Like a first year geology exam, he was 
asked to identify rocks by name and mineral content. 

Desalts of the Simulation 

DARI' proved to be highly dexterous, capable of per- 
forming even the slightest movements with amazing accura- 
cy and control. In addition to tasks assigned in our 
simulation, seasoned operators used DART to tie a knot in a 
rope, an arguably sophisticated task for virtual presence 
technology. Our experiment has encouraged us to pursue 
the use of robots as tclepresent explorers, under the direct 
control of humans. 

The robot was able to use a variety of tools, with very lit- 
tle time required to train operators unfamiliar with field 
geology techniques. DART was able to wield a hammer, chip 
a rock, place rocks in sample container baggies, and use 
rakes and shovels. The rock tongs were quite difficult to use 


at first, because of design idiosyncrasies specific to huma 
hands. However, like most of the Apollo tools we used i 
the simulation, DART would be able to use them more efi 
ciently with a few very minor modifications. 

One area where DART needs improvement for planetai 
applications is in its optical system. The current camera syt 
tern lacks sufficient resolution to distinguish fine rock te> 
tures, color, and other features. In fact, the geologist was abl 
to determine only the most obvious rock types and mineral 
using both the head camera and hand camera views. Fo 
example, the geologist correctly identified a basalt sample 
but could not distinguish coarse-grained quartz or anothe 
sample containing large blood-red garnet crystals one-inch ii 
diameter. One factor limiting the optics during the Simula 
tion was the overhead fluorescent lighting in the laboratory 
which subdues color and is too dim for rock identification. 

We found that our novice geologist operators were able t< 
learn to operate DART with a minimal amount of training 
usually two or three sessions. Sensory feedback wouh 
improve the system considerably, providing greater contro 
and the “you are there” advantage for the operator. 

Applying DART Technology to 
the Search for Past Life no Mars 

On 7 August 1996, NASA Administrator Dan Goldii 
announced that NASA’s David McKay and colleagues hac 
detected tiny (200 nannometers) tubular structures tha 
resemble ancient fossilized Earth microbes in the 4.5 billion 
year-old Mars meteorite ALH84001. These features co 
occur with organic molecules and iron mineral 
characteristic of biological waste products. Together the evi 
dence points toward the possibility that microbial-like lift 
existed on early Mars. Given that these microscopic feature: 
derive from Mars and presumably others like them still exisi 
somewhere on the planet, future explorations of Mars wik 
most certainly focus on locating and sampling more of them 
Indeed, one of the top priority science questions for Man 
before and after the advent of the ALH84001 finding:? 
remains: “Did life ever exist during Mars’ Earth-like history 
and if so, is there still any life on Mars?” 

However, going to Mars to find another ALH84001 will 
be difficult. We do not know where on Mars the meteorite 
originated although scientists have suggested possible sites 
of origin. We can, however, use our geologic knowledge ol 
Earth environments, past and present, known to be hos 
pitable to microorganisms, and look for similar environ 
ments on Mars. Ancient Martian lake beds dating from a 
time when Mars was warmer and wetter, are considered to 
be one of the more promising sites to have quietly ponded 
and preserved microfossils. 

Once targeted, areas on Mars such as the lake beds could 
be explored for past life. But how would we best undertake 
this mission? NASA’s next robotic Mars missions. Mars 
Pathfinder and Mars Global Surveyor, have neither the 
objective nor the capability to search for past life-forms. 
Could DART technology be used to hunt for fossils in this 
scenario? Based on the current capabilities of DART, it is 
not a straightforward task. To immediately find and recog 
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Apollo 1 6 astronaut John Young 
performs field geology on the Moon, 
grasping a rock hammer with tired 
hands after setting up gnomon 
on lunar surface. EVA gloves and 
suits were cumbersome and 
awkward for delicate tasks. 




u 


nize fossilized evidence will be difficult for robots, and 
equally unlikely for human explorers. Rocks bearing such 
tiny structures are simply not going to appear any different 
than adjacent “barren” sediments. 

Where DART would make its contribution in the search 
for life would be in the two areas of technical superiority 
and human participation. The search for past lite will take a 
lot of slow, methodical field work, which translates into 
numerous long duration EVAs. DART has the capability to 
explore the harsh Martian surface in the worst conditions, 
for prolonged EVAs, posing no risk to human life. Where 
DART’s direct optical capabilities would equal a humans, 
its ability to use imaging systems of dilfering wavelengths, as 
well as its strength and stamina, would far exceed that of 
human explorers. Further, the DARI camera and arms 
could be equipped with spectral and Mossbauer-like analyti- 
cal tools capable of differentiating mineralogies characteris- 
tic of ALH84001 . 

At any given time only one "master can wear the Mil 
gear and "be” on Mars in a virtual presence mode. 
However, DARTs observations would be simultaneously 
available in real time video to the best geologists and 
micropaleontologists the community could assemble. As 
experienced geoscientists “virtually” gathered clues to past 
Martian life, they could reconfigure the exploration strategy. 


constantly improving the potential for discovery. Working 
together through virtual presence, geologist and robot could 
svmbioticailv search for life on the Red Planet. 

Future Research 

Our first simulation compared the capabilities of DART 
with those of a human field geologist on Earth. Future studies 
will call upon NASA astronaut and Moon-walker John Young 
to compare DARTs capabilities to those of a human confined 
bv an awkward EVA suit and bulky pressurized gloves. Other 
upcoming work will explore possibilities for equipping DART 
with special sensors to analyze minerals in the field, or special- 
ized cameras that can zoom and focus only inches away or 
miles from DARI. We will further consider slight modifica- 
tions to field geologv tools that would make them easier to 
operate on an extraterrestrial planet surface. We will continue 
the quest to explore where no man has gone before. Using 
tdepresent robots lor some of the more dangerous areas, perhaps 
no humans will have to go into treacherous terrain at all. * 

XiWCY Ann Binlden conducted this research while at NASA 
Johnson Space Center; she continues this work as a Visit mo 
Scientist at the Lunar and Planetary Institute. Phis article is 
LPI Contribution S7 5. 
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